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Abstract. This paper presents a group of analytical formulas for calculating the global maximal and minimal ranks 
and inertias of the quadratic matrix-valued function cj)(X) — (AXB + C )M(AXB + C)* + D and use them to derive 
necessary and sufficient conditions for the two types of multiple quadratic matrix-valued function 
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to be semi-definite, respectively, where Ai, Bi, d, C, D, Mi and M are given matrices with Mi, M and D Hermitian, 
i = 1, . . . , k. Lowner partial ordering optimizations of the two matrix-valued functions are studied and their solutions 
are characterized. 
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1 Introduction 

This is the third part of the present author's work on quadratic matrix-valued functions and theii algebraic 
properties. A matrix- valued function for complex matrices is a map between two matrix spaces (£ mxn and 
fH ■ C pxq , which can generally be written as 

> ' 

Y = /(A) for Y e C mxn and X e C pxq , 

or briefly, / : C mxn — > C pxq . As usual, linear and quadratic matrix-valued functions, as common representatives 
of various matrix-valued functions, are extensively studied from theoretical and applied points of view. 
In this paper, we consider the following two types of multiple quadratic matrix-valued function 

in : </>(x 1 ,...,x k ) = ( j2 A i x i B i+ c ) M [ J2 A i XiBi+c ) +D > ( L1 ) 

'. V i=i ) \ z=i / 

! xP(Xx,...,X k ) =^2(A i X i B i + Ci)Mi(A i X i B i + C i )* + D, (1.2) 

m 



where Ai, Bi, Cj, C, D, Mi and M are given matrices with Mi, M and D Hermitian, A,; is a variable matrix, 
i = l,...,k. Eqs. (fTTTj) or (JT73) for fc = 1 is 

<P(X) = (AXB + C)M(AXB + C)* +D, (1.3) 

where AeC nxp , B e C' nxq , C G C nxq , D 6 Cj^ and M € are given, and X E C pxm is a variable matrix. 
We treat it as a combination <f> — r o p of the following two simple linear and quadratic Hermitian matrix- valued 
functions: 



p: X ~> AXB + C, t :Y -+YMY* + D. (1.4) 

For different choices of the given matrices, this quadratic function between matrix spaces includes many ordinary 
quadratic forms and quadratic matrix-valued functions as its special cases, such as, x*Ax, AAA*, DXX*D* , 
(X -C)M(X -C)*, etc. 

It is well known that quadratic functions in elementary mathematics and ordinary quadratic forms in linear 
algebra have a fairly complete theory with a long history and numerous applications. Much of the beauty of 
these quadratic objects were highly appreciated by mathematicians in all times, and and many of the fundamen- 
tal ideas of quadratic functions and quadratic forms were developed in all branches of mathematics. While the 
mathematics of classic quadratic forms has been established for about one and a half century, various extensions 
of classic quadratic forms to some general settings were conducted from theoretical and applied point of view, in 
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particular, quadratic matrix-valued functions and the corresponding quadratic matrix equations and quadratic 
matrix inequalities often appear briefly when needed to solve a variety of problems in mathematics and applica- 
tions. These quadratic objects have many attractive features both from manipulative and computational point 
of view, and there is an intensive interest in studying behaviors of quadratic matrix- valued functions, quadratic 
matrix equations and quadratic matrix inequalities. In fact, any essential development on the researches of 
quadratic objects will lead to many progresses in both mathematics and applications. Compared with the the- 
ory of ordinary quadratic functions and forms, two distinctive features of quadratic matrix-valued functions are 
the freedom of entries in variable matrices and the non-commutativity of matrix algebra. So that there is no 
a general theory for describing behaviors of a given quadratic matrix-valued function with multiple terms. In 
particular, to solve an optimization problem on a quadratic matrix-valued function is believed to be NP hard in 
general, and thus there is a long way to go to establish a perfect theory on quadratic matrix-valued functions. 
In recent years, Tian conducted a seminal study on quadratic matrix- valued functions in [5J[TU], which gave an 
initial quantitative understanding of the nature of matrix rank and inertia optimization problems, in particular, 
a simple and precise linearization method was introduced for studying quadratic or nonlinear matrix-valued 
functions, and many explicit formulas were established for calculating the extremal ranks and inertias of some 
simple quadratic matrix-valued functions. For applications of quadratic matrix-valued functions, quadratic 
matrix equations and quadratic matrix inequalities in optimization theory, system and control theory, see the 
references given in [5J [TU] . 
Throughout this paper, 

C mx " stands for the set of all m x n complex matrices; 

CJj stands for the set of all m x m complex Hermitian matrices; 

A*, r(A) and &(A) stand for the conjugate transpose, rank and range (column space) of a matrix A S 
C mx ", respectively; 

I m denotes the identity matrix of order m; 

[A, B] denotes a row block matrix consisting of A and B; 

the Moore-Penrose inverse of A e C mx ™, denoted by A\ is defined to be the unique solution X satisfying 
the four matrix equations AX A = A, XAX = X, (AX)* = AX and (XA)* = XA; 

the symbols Ea and Fa stand for Ea = I m — AA^ and Fa = I n — A^A; 

an X e C nxm is called a ^-inverse of A G C mxn , denoted by A~ , if it satisfies AX A = A; 

an X G Cj^ is called a Hermitian g- inverse of A S CjJ, denoted by if it satisfies AX A = A; called a 
reflexive Hermitian g- inverse of A 6 CjJ , denoted by A~ , if it satisfies AX A = A and XAX = X; 

i+(A) and i-(A), called the partial inertia of A S C£f, are defined to be the numbers of the positive and 
negative eigenvalues of A counted with multiplicities, respectively; 

A >- (A )p 0, -< 0, =^ 0) means that A is Hermitian positive definite (positive semi-definite, negative 
definite, negative semi-definite); 

two A, B e CjJ are said to satisfy the inequality A >- B (A >p B) in the Lowner partial ordering if A — B 
is positive definite (positive semi-definite). 

2 Problem formulation 

Matrix rank and inertia optimization problems are a class of discontinuous optimization problems, in which 
decision variables are matrices running over certain matrix sets, while the rank and inertia of the variable 
matrices are taken as integer-valued objective functions. Because rank and inertia of matrices are always 
integers, no approximation methods are allowed to use when finding the maximal and minimal possible ranks 
and inertias of a matrix-valued function. So that matrix rank and inertia optimization problems are not 
consistent with anyone of the ordinary continuous and discrete problems in optimization theory. Less people 
paid attention to this kind of optimization problems, and no complete theory was established. But, the present 
author has been working on this topic with great effort in the past 30 years, and contribute a huge amount of 
results on matrix rank and inertia optimization problems. 

A major purpose of this paper is to develop a unified optimization theory on ranks, inertias and partial 
orderings of quadratic matrix-valued functions by using pure algebraic operations of matrices, which enables 
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us to handle many mathematical and applied problems on behaviors of quadratic matrix-valued functions, 
quadratic matrix equations and quadratic matrix inequalities. The rank and inertia of a (Hermitian) matrix 
are two oldest basic concepts in linear algebra for describing the dimension of the row/column vector space 
and the sign distribution of the eigenvalues of the square matrix, which are well understood and are easy to 
compute by the well-known elementary or congruent matrix operations. These two quantities play an essential 
role in characterizing algebraic properties of (Hermitian) matrices. Because concepts of ranks and inertias are so 
generic in linear algebra, it is doubt that a primary work in linear algebra is to establish (expansion) formulas for 
calculating ranks and inertias of matrices as more as possible. However, this valuable work was really neglected 
in the development of linear algebra, and a great chance for discovering thousands of rank and inertia formulas, 
some of which are given in Lemmas 3.2, 3.3, 3.5 and 3.6 below, were lost in the earlier period of linear algebra. 
This paper tries to make some essential contributions on establishing formulas for ranks and inertias of some 
quadratic matrix-valued functions. 

Taking the rank and inertia of (|1.3[) as inter-valued objective functions, we solve the following problems: 

Problem 2.1 For the function in (| 1 . 3[) . establish explicit formulas for calculating the following global extremal 
ranks and inertias 

max rWX)], min rWX)], max i ± U(X)], min i±WX)}. (2.1) 

X£Cp xm xgCpx™ xecp xm xecp xm 

Problem 2.2 For the function in (|1.3j) . 

(i) establish necessary and sufficient conditions for the existence of an J £ C xm such that 

<P(X)=0; (2.2) 

(ii) establish necessary and sufficient conditions for the following inequalities 

4>(x) y o, 4>{X) y o, 4>(X) ~< o, 4>{X) 4 (2.3) 

to hold for an X G C pxm , respectively; 

(iii) establish necessary and sufficient conditions for 

4>(X) >- 0, (j){X) >f 0, 4>(X) -< 0, (j){X) 4 for all X G C pxm (2.4) 

to hold, respectively, namely, to give identifying conditions for 4>{X) to be a positive definite, positive 
semi-definite, negative definite, negative semi-definite function on complex matrices, respectively. 

Problem 2.3 For the function in (|1.3[) . establish necessary and sufficient conditions for the existence of X, X G 
C pxm such that 

<p(x) y <p(x), 4>{x) 4 4>{x) (2.5) 

hold for all X G CP xm 5 respectively, and derive analytical expressions of the two matrices X and X. 

3 Preliminary results 

The ranks and inertias are two generic indices in finite dimensional algebras. The results related to these indices 
are unreplaceable by any other quantitative tools in mathematics. A simple but striking fact about the indices 
is stated in following lemma. 

Lemma 3.1 Let S be a subset in C mxn , and let % be a subset in CjJ . Then the following hold. 

(a) Under m — n, S has a nonsingular matrix if and only ifmaxxes r {X) = m. 

(b) Under m ~ n, all X G S are nonsingular if and only if minxes r (X) = m. 

(c) G S if and only if minxes r (X) = 0. 

(d) S = {0} if and only if maxxes r (X) = 0. 

(e) T-L has a matrix X >~ (X -<, 0) if and only if maxxeu *+(^0 — m ( max^gM i-(X) = m ). 



3 



(f) All X G H satisfy X >~ (X -< 0), namely, % is a subset of the cone of positive definite matrices [negative 
definite matrices) , if and only if min^ e % i + (X) = m ( minxeu *-(^0 — m )• 

(g) % ftas a matrix X (X =<! 0) if and onZy «/ minxes i- (-^Q = ( min^e-H =0). 

(h) All X <E H satisfy X )p (X =<! 0), namely, % is a subset of the cone of positive semi-definite matrices ( 
negative semi-definite matrices), if and only i/maxxEK'-W = ( maxjf z + ( X) = 0). 

The question of whether a given matrix-valued function is semi-definite everywhere is ubiquitous in matrix 
theory and applications. Lemma |3jje)-(h) assert that if certain explicit formulas for calculating the global 
maximal and minimal inertias of Hermitian matrix-valued functions are established, we can use them as a 
quantitative tool, as demonstrated in Sections 2-7 below, to derive necessary and sufficient conditions for the 
matrix-valued functions to be definite or semi-definite. In addition, we are able to use these inertia formulas 
to establish various matrix inequalities in the Lowner partial ordering, and to solve many matrix optimization 
problems in the Lowner partial ordering. 

The following are obvious or well known (see [8]), which will be used in the latter part of this paper. 



Lemma 3.2 Let A E 



'H I 



B e 



'Hi 



: mxn , and P e C px 
i±(PAP 



with r(P) = to. Then, 



A 








B 





Q 


Q* 





(£yn x n 


Mi 





i ± (XA) = 
= i ± (A) 



= i±(A), 

i±(A) if A > 
i T (A) if A < ' 





Q* 



Q 
o 



= r(Q). 



Lemma 3.3 ([7J) Let A e C£\ B e 



Then, the following expansion formulas hold 
i±(M 1 ) = r{B) + i±(E B AE B ), 

i±(M 2 ) = i±(A) + i ± 



D e 

A 
B* 



'H> 



B 




aTid let 



Mo 



A 

B* 



B 
D 





B*E A 



E A B 
D - B*A^B 



r(M 1 ) = 2r(B)+r(E B AE B ), 




r(M 2 ) = r(A) + r 



B*E A D 



E A B 
- B*A^B 



r(M 1 )=r[A ) B] 
-{Mi) =r[A, B], r(M 1 )=r[A,B] 



"(B). 



"(B). 



Ln particular, the following hold. 

(a) I/A ^ 0, then 

i+(M 1 ) = r[A, B], i_(Mi)=r(B), 

(b) If A 4 0, then 

i+(Mi) = r(B), 

(c) If M(B) C 3£(A), then 

i±(M 2 ) = i±(A) +i±(D- B*A^B), r(M 2 ) = r{A) +r{D- B*A^B \ 

(d) r(M 2 ) = r{A) & 31(B) C 31(A) and D = B* A^B. 

(e) M 2 ^ & A )? 0, M(B) C 32(A) and D - B*A^B ^ 0. 

:n be given. Then the matrix equation AXB 



Lemma 3.4 Q5J) Let A e C mxp , B e C qxn and C G C m> 
consistent if and only if M(C) C 32(A) and 32(C*) C ^(5* 
general solution can be written as 



(3.1) 
(3.2) 

(3.3) 

(3.4) 



(3.5) 
(3.6) 



(3.7) 



(3.8) 



(3.9) 



C is 



or equivalently, AA'CB^ B = C. In this case, the 

(3.10) 



X = A>CB^ + F A Vi + V 2 E B , 
where V± and V 2 are arbitrary matrices. In particular, AXB = C has a unique solution if and only if 

r{A)=p, r(B)=q, 31(C) Q 31(A) , M(C*) C 3$(B*). (3.11) 
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Lemma 3.5 (mElE]) Let A G C mxn , B G C mxp and C G C« x ™ 6e given, and X G C px « 6e a vana&Ze 
matrix. Then, the global maximal and minimal ranks of A + BXC are given by 



max r(A + BXC) = min <r[A, B], r 



min r(A + BIC) = r[A Bl + r 

xecpx" 



"A" 




A 


B 


c* 


— r 


C 






(3.12) 
(3.13) 



Lemma 3.6 ([4j) Let A E , B E C mxn and C E C pym be given, X G C nyp be a variable matrix. Then, 

(3.14) 

+ t+}, (3.15) 
(3.16) 



max r[ A + BXC + (BXC)* ] = mini r\A, B, C*], r 

xeC" x p 



XgC" x p 



min i±[i + BXC+(51C)*] = r[ A, B, C*]+max{s±, t± }, 









C* " 




B* 


C 





} 


5+ + S_, f 




«- 




— • 





' A 


B ' 




' A 


C* ' 






B* 





, i± 


C 





} 





' A 


B 




A 


B 


c*~ 


, t±=i± 


A 


C*~ 




' A 


B 


c* 


s± = i ± 


B* 





— r 


B* 








C 





— r 


C 









where 



4 Main results 

We first solve Problem 1.1 through a linearization method and Theorem 1.8. 
Theorem 4.1 Let 4>(X) be as given in (|1.3[) . and define 



Nx = 
N 3 = 



D + CMC* A 

A* 

D + CMC* CMB 

BMC* BMB 



N 2 = 



X 



D + CMC* CMB* A 
A* 

D + CMC* CMB* A 
BMC* BMB* 



Then, the global maximal and minimal ranks and inertias of 4>{X) are given by 
max r[(f)(X)] — min{r[D + CMC*, CMB*, A], r(Ni), r(N 3 )} , 

min r[(j)(X) ] = 2r[D + CMC* , CMB*, A] + max{ s%, s 2 , s 3 , s 4 }, 

xecp* m 

max i±[(f)(X)] = min {i±(N{), i±(N 3 )}, 

XGCP xm 

min i±U(X)] =r[D + CMC*, CMB*, A] + max { i±(N{) - rfJVb), i±(N 3 ) - r(iV 4 ) } , 

xecp xm 

w/iere 

«l - r(JVi) - 2r(7V 2 ), S2 = r(JV 3 ) - 2r(7V 4 ), 

s 3 = i+(JV x ) + i_(JV 3 ) - r(N 2 ) - r(N 4 ), s 4 = t_(JVi) + i+C/V 3 ) - r(7V 2 ) - r(iV 4 ). 
Proof. It is easy to verify from (I3.6P that 



i ± [(AXB + (7)M(AXB + C)* +£>] =i± 
r[(AXB + C*)Af(AXB + C)* + D \ = 



—M M{AXB + C)* 

(AXB + C)M D 

-M M(AXB + Cy~ 

(AXB + C)M D 



*±(-M), 
-r(M). 



(3.17) 



(4.1) 
(4.2) 

(4.3) 
(4.4) 
(4.5) 
(4.6) 



(4.7) 
(4.8) 



that is, the rank and inertia of <fi(X) in (|1.3I) can be calculated by those of the following linear matrix-valued 
function 



-M M(AXB + Cy 

( AXB + C)M D 

X[BM,0] 



-M MC*~ 




' " 


CM D 


+ 


A 



MB* 




X*[0, A* 



(4.9) 
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Note from (@T7J) and flU]) that 



max r\d>(X)] = max rf"0f-^)l —r(A), 
xecpx™ xecpx™ 

min r\d>(X)] = min r\ip(X)} — r(A), 

max i±[(j>(X)] = max i±\ifj(X)] — izr(A), 

xecpx™ xecp xm 

min i ± [0(X)l = min i±hp(X)] - i T (A). 



Applying Lemma [3761 to (|4.9[) . we first obtain 



maxr[^)]=min{r(ff), r(Gi), r(G 2 ) }, 

xecpxm 

min r[V>(A)l = 2r(iJ) + max{ s+ + s_, t + + t-, s + +t_, s_+i + }, 

xecpx'« 

max i±Up(X)] = min{ i±(Gi), i±(G 2 )i, 

xeo xm 

min iifV'fA)! = r(7J) + max{ s+, t± }, 

XgCpx™ 



(4.10) 
(4.11) 
(4.12) 
(4.13) 

(4.14) 
(4.15) 
(4.16) 
(4.17) 



where 



H 



—M MC* MB* 
CM D A 



-M MC* 



CM D 
A* 



A 




G 2 



-M MG* MS* 



CM L> 
BM 



Hi 



-M MC* MB* 
CM D A 
A* 



—M MC* MB* 
GM D OA 
BM 



and 



s± = i±(Gi) - r(ffi), *± = i±(G 2 )-r(ff 2 



It is easy to derive from Lemmas 13.21 and 13.31 elementary matrix operations and congruence matrix operations 
that 



r(H) = r(M) +r[D + CMC*, CMB*, A], 

' D + CMC* CMB* A 
A* 



r(Hi) = r 
i±{Gi) = i T (M)+i± 



C + CMC* A 
A* 



, r(H 2 )=r(M)+r 

i±(G 2 ) =i T (M) + i± 



D + CMC* CMB* A 
BMC* BMB* 



D + CMC* CMB* 
BMC* BMB* 



Hence, 



r(G x ) = r(M) + r(2V x ), r(G 2 ) = r(M) + r(JV 3 ), 
s± = »±(Gi) - r{Hi) = i±(JVi) - r(JV 2 ) - J± (M), 
i± = i±(G 2 ) - r(£T a ) - i±(iVa) - r(N 4 ) - i±(M). 



(4.18) 
(4.19) 

(4.20) 



(4.21) 
(4.22) 
(4.23) 



Substituting (f47l8|) - (j4723|) into (|47i5 ]l -([337 1l . and then (|4~T4j) - (|4T7l) into (|4TT0j) - (|4~T3l) . we obtain (|474j) - (|4~7l) . 



□ 



Without loss of generality, we assume in what follows that both A =1 and BMB* ^ in ()1.3|) . Applying 
Lemma 1.4 to (j4.3|) - (j4.6|) . we obtain the following results. 



Corollary 4.2 Let <j>{X) be as given in (|1.3j) . and N\ and N% be the matrices of ()4.1j) and (j4.2j) . Then, the 
following hold. 

(a) There exists an X £ ^px™ suc /j that <fi(X) is nonsingular if and only if r[D + CMC*, CMB*, A] = n, 
r(Nx) > n and r(N 3 ) ^ n. 

(b) 4>{X) is nonsingular for all X G £jP xm if an d only if r( D + CMC* ) = n, and one of the following four 
conditions holds 



(i) BMC*(D + CMC* )~ 1 A = and A*( _D + CMC* )~ 1 A = 0. 



(> 



(ii) BMC*(D + CMC*y 1 A = and BMC*(D + CMC* ^CMB* = BMB* . 

(iii) A*(D+CMC* )^A fc= 0, BMB* -BMC* (D+CMC* )~ 1 CMB* 0, M\ A*( D+CMC* )~ 1 CMB*\ C 
M[A*{ D+CMC* y 1 A]and,^[BMC*{ D+CMC* )~ 1 A] C (%\ BMB* -BMC* ( D+CMC* ) - 1 CM 5* 

(iv) A*(D+CMC*)- 1 A 4 0, BMB*-BMC*(D+CMC*)- 1 CMB* 4 0, ^[ A*( D+CMC* )- l CMB*] C 
«[4*(D+CMC*)- l i], and^lBMC^D+CA/C*)- 1 ^] C M[BMB*—BMC*(D+CMC* )~ 1 CMB* 

(c) There exists an X G C pxm sucfi. £/ia£ = 0, namely, the matrix equation in (I2.2[) is consistent, if and 
only if 

M{D + CMC* ) c^[A, CMB*], r{M 1 ) = 2r{A), 2r[A, CMB*] + r(N 3 ) - 2r(N 4 ) 4 0, 
r[A, CMB*]+i + (N 3 ) -r(Ni) < 0, r[A, CMB* ] + i-{N 3 ) — r(N 4 ) 0. 

(d) There exists an X G CP xm smc/i i/iai 4>{X) y 0, namely, the matrix inequality is feasible, if and only if 

i+(Ni) = n and i + (N 3 ) n, or i + (Ni) n and i + (N 3 ) = n. 

(c) There exists an X £ C pxm suc/i t/ia£ <I>{X) -< 0, £/ie matrix inequality is feasible, if and only if 
i_(iVi) = n and i-(N 3 ) n, or i_(iVi) n and i-(N 3 ) = n. 

(f) </>(X) >- /or a// X G C pxm , namely, 4>{X) is a completely positive matrix-valued function, if and only if 



D + CMC* >-0, N 3 y0, & 



(g) <^(-X") -< /or a/Z X G C pxm namely, 4>{X) is a completely negative matrix-valued function, if and only if 



D + CMC* < 0, iV 3 ^ o, at 



(h) There exists an X G C pxm such that 4>{X) !j= 0, namely, the matrix inequality is feasible, if and only if 

r[D + CMC*, CMB*, A] + i-{N x ) sC r{N 2 ) and r[D + CMC*, CMB*, A] + i-(N 3 ) < r(jV 4 ). 

(i) There exists an X G <C pxm such that <fi(X) =4 0, namely, the matrix inequality is feasible, if and only if 

r[D + CMC*, CMB*, A] + i+{N 1 ) < r{N 2 ) and r[D + CMC*, CMB*, A] + i+(N 3 ) < r(N 4 ). 

(j) 4>(X) )p for all X G C pxm , namely, <f>{X) is a positive a positive matrix-valued function, if and only if 
A, • 0. 

(k) (j)(X) =4 for all X G C pxm , namely, <f>{X) is a negative matrix-valued function, if and only if N 3 =^ 0. 
Proof. We only show (b). Under the condition r(D + CMC* ) = n, (j4.4|) reduces to 

min r[4>(X) 1 = 2n + max{ s\, s 2 , s 3 , S4}, (4.24) 

X£C? xm 

where 

si =r[4*(D + C*MC*)" 1 A] - 2r[ A*( Z? + CMC* )~ X CMB*, A*(D + CMC* )~ 1 A] - n, 
s 2 =r[BMB* - BMC* {D + CMC*)- 1 CMB*] 

— 2r[BMB* — BMC*(D + CMC* )~ 1 CMB* , BMC*(D + CMC*)~ 1 A] -n, 
s 3 = ^[^(D + CAfC**)- 1 ^] +i_[BMB* - BMC*(D + CMC*)- 1 CMB*] 
-r[A*(D + CMC* y 1 CMB*, A*(D + CMC* 

- r[BMB* - BMC*(D + CMC* )~ l CMB*, BMC*(D + CMC* )~ 1 A]-n, 
s 4 =i+[A*(D + CMC*y 1 A] +i + [BMB* - BMC*(D + CMC*y 1 CMB*} 

- r[ A*(D + CMC* )~ l CMB*, A*(D + CMC* ^A] 

- r[BMB* - BMC*(D + CMC* )~ 1 CMB*, BMC*{D + CMC* y 1 A] - n. 

Setting (|4.24j) equal to n, we see that 4>{X) is nonsingular for all X G C pxm if and only if r(D + CMC*) = n, 
and one of the following four rank equalities holds 
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(i) r[A*(D + CMC*)- X A] = 2r[A*(D + CMC* )~ 1 CMB*, A*(D + CMC* 

(ii) r[BMB* - BMC*(D + CMC* )~ 1 CMB* } 

= 2r[BMB* - BMC*(D + CMC* )- x CMB*, BMC*(D + CMC* 

(iii) i-[A*{ D + CMC* )" 1 J 4] + i-[BMB* - BMC*(D + CMC* )~ 1 CMB* } 
= r[A*(D + CMC* y-CMB*, A*(D + CMC*y 1 A} 

+ r[BMB* - BMC*(D + CMC*)- 1 CMB* 1 BMC*(D + CMC* )~ X A]; 

(iv) i+[A*(D + CMC*)- 1 A] + i+[BMB* - BMC*(D + CMC*)~ 1 CMB*] 
= r[A*(D + CMC* ) - 1 CM B* , A*(D + CMC* )~ 1 A] 

+ r[BMB* - BMC*(D + CMC* )~ 1 CMB* , BMC*(D + CMC* )- x A] - n; 
which are further equivalent to the result in (b) by comparing both sides of the four rank equalities. □ 
A special case of (| 1 . 3[) is 

4>(X) = (AXB + C) (AXB + C)* -I n , (4.25) 

where 4>{X) = means that the rows of AXB + C are orthogonal. Further, if AXB + C is square, <fi(X) = 
means that AXB + C is unitary. Applying Theorem 4.1 and Corollary 4.2 to (|4.25[) will yield a group of 
consequences. 



Theorem 4.3 Let 4>(X) be as given in (|1.3[) . and define 



N 3 



cc* - I n 


A 




A* 





1 


CC* - I n 


CB* 


BC* 


BB* 



N 9 



CC* - I n CB* A 
A* 

CC* - I n CB* A 
BC* BB* 



Then, the global maximal and minimal ranks and inertias of 4>{X) are given by 
max r[(f>(X)] =mxa{r[CC* - I n , CB*, A], r(iV x ), r(N 3 ) } , 
min r[(f>(X) ] = 2r[CC* — I n , CB* , A] + max{ si, s 2 , s 3 , s 4 }, 
max i±[(j>(X)] = min{i±(Ni), i±(N 3 ) } , 

min i±[4>{X)] =r[CC* -I n , CB*, A] + max{ i±(Ni) - r(N 2 ), i±(N 3 ) - r(N 4 ) } , 

XgC xm 

where 



(4.26) 
(4.27) 

(4.28) 
(4.29) 
(4.30) 
(4.31) 



«l = r(iVi) - 2r(N 2 ), s 2 = r(N 3 ) - 2r(N 4 ), 

s 3 = i + (Nx) + i-(N 3 ) - r(N 2 ) - r(N 4 ), s 4 = i_(N x ) + i+(N 3 ) - r(N 2 ) - r(N 4 ). 

Whether a given function is positive or nonnegative everywhere is a fundamental research subject in both 
elementary and advanced mathematics. It was realized in matrix theory that the complexity status of the 
definite and semi-definite feasibility problems of a general matrix-valued function is NP-hard. Corollarv l4.2f d)- 
(k), however, show that we are really able to characterize the dcfinitcness and scmi-definiteness of (|1.3[) by using 
some ordinary and elementary methods. These results set up a criterion for characterizing definiteness and 
semi-definiteness of nonlinear matrix-valued functions, and will prompt more investigations on this challenging 
topic. In particular, definiteness and semi-definiteness of some nonlinear matrix-valued functions generated 
from (|1.3|) can be identified. We shall present them in another paper. 

Recall that a Hcrmitian matrix A can uniquely be decomposed as the difference of two disjoint Hermitian 
positive semi-definite definite matrices 



A = A X -A 2 , AiA 2 = A 2 Ai = 0, Ai^O, A 2 )>= 0. 
Applying this assertion to (|1.3|) . we obtain the following result. 



(4.32) 



Corollary 4.4 Let 4>{X) be as given in (jl.3l) . Then, 4>{X) can always be decomposed as 

^(X) = MX)-MX), (4.33) 

where 

0i (X) = (AXB + C)M 1 (AXB + C)* + D u 4> 2 (X) = (AXB + C)M 2 (AXB + C)* + D 2 

satisfy 

MX)>0, MX)^0 (4.34) 

for all X G C pxm . 

Proof. Note from (I4.32[) that the two Hermitian matrices D and M in (|1.3p can uniquely be decomposed as 

D = D 1 -D 2 , D X D 2 = D 2 D 1 = 0, D x ^ 0, £> 2 0, 
M = Mi - M 2 , MiM 2 = M 2 M 1 = 0, Mi ^ 0, Af 2 0, 

So that 0i (X) and <f> 2 (X) in (|4.33|) are positive matrix- valued functions. □ 



Corollary 4.5 Lei <j>(X) be as given in (|1.3p . and suppose that AXB + C = /ias a solution, i.e., M{C) C <%(A) 

D A 

Inen, 



and M(C*) C ffl(B*), and let N 



A* 



max r[0(X)l = min{r[A, £>], r(BMB*) + r(D)] } , 

xecp xm 



(4.35) 



min r[0(X) ] = max{ 2r[A, D] - r(M), r(D) - r(BM B*), r[A, D] + i-(D) — i + (BMB*) — i-(N), 

r[A, D]+i + {D)-i_{BMB*)-i + {N)}, 
max i±U(X)l =mm{i±(M), i±(BMB*) + i±(D)} , 

min i±U(X)] =max{r[A, D] -i=(N), i±(D) - i=(BMB*)\ . 



(4.36) 
(4.37) 

(4.38) 



Corollary 4.6 Let 



<p(X) = (AX + C )M( AX + (7)* + £>, 



(4.39) 



where A G C nxp , C £ c™x« l 5 £) g eg and M G are given, and X G C pxm is a variable matrix, and define 



D + CMC* A 
A* 



, ^2 



D CM A 
A* 



(4.40) 



Then, 



max rUpO ]= min {r[ A, CM, D], r(iVi), r(M)+r(£>)}, (4.41) 

xecp xm 

min r[0(X) ] = 2r[A, CM, D] + max{ si, s 2 , s 3 , s 4 }, (4.42) 

xecp xm 

maxi±U(X)]=mm{i±(Ni), i±(M) +i±(D)\ , (4.43) 

xeo xm 

min i±U(X)] =r[D, CM, A] + max{i ± (N 1 ) -r(N 2 ), i±(D) - r[A, D] -%(M)}, (4.44) 



where 



si = r(JVk) - 2r(iV 2 ), s 2 = r(U) - 2r[A D] - r(M), 

S3 = »+(JVi) - r(N 2 ) - »_(£>) -r[A D] - i+(M), s 4 = i-(N x ) - r(N 2 ) - »+(£>) - r[A, D] - *_(M). 



Corollary 4.7 Lei 



0(X) = (XB + C )M( IB + C)* + D, 



(4.45) 
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where B G C pxm , C G C nxm , £) £ and MeCJf are groen, and X e C nxp is a variable matrix, and define 



Ni = 



D + CMC* CMB* 
BMC* BMB* 



N 2 = [ BMB*, BMC* ]. (4.46) 



Then, 



max r[4>{X)] = n, (4.47) 

mill r[(f>(X)] =max{0, r(JVi) - 2(JV 2 ), »+(JVi) - r(JV 2 ), i_(JVi) - r(N 2 ) }, (4.48) 

max i± [ 0(X) ] = min { n, i±(Ni)} , (4.49) 

min i ± [(/)(X)l = n + max{0, i±(N 1 ) - r(N 2 )} . (4.50) 

We next solve the two quadratic optimization problems in ()2.5|) . where the two matrices 4>(X) and 4>{X), 

when they exist, are called the global maximal and minimal matrices of <j>{X) in (|1.3|) in the Lowner partial 
ordering, respectively. 



D + CMC* CMB 
B*MC B*MB 



Then, there exists an 



Corollary 4.8 Let 4>(X) be as given in (|1.3[) . and let N 

X G C pxm such that 

cf>(X) )? <j>(X) (4.51) 

holds for all X G C pxm if and only if 

BMB* ^ 0, @(CMB*) C M{A), M(BMC*) C M(BMB*). (4.52) 
In this case, the following hold. 

(a) The matrix X G C pxm satisfying (|4.51|) is the solution of the linear matrix equation 

AX BMB* + CMB* = 0. (4.53) 

Correspondingly, 

X = -A f CMB*(BMB*) jf +F A V 1 +V 2 E BM B', (4.54) 

(f>(X) = D + CMC* - CM B* [BM B*)^ BMC* , (4.55) 

(f>(X) -4>(X) = (AXB + C)MB*{BMB*y BM(AXB + C)* , (4.56) 

where V% and V 2 are arbitrary matrices. 

(b) The inertias and ranks of <f>{X) and 4>(X) — 4>(X) are given by 

i+[4>{X)]=i + {N)-r{BMB*), %-[<j>{X) ] = i-(N), r[(j>(X) } = r(N) — r(BMB*), (4.57) 
i+[4>(X) - 4>(X)} = r[(f>(X) - 4>(X)} = r( AX BMB* + CMB* ). (4.58) 

(c) The matrix X G <C pxm satisfying (|4.51[) is unique if and only if 

r(A) = p, M(CMB*) C M(A), BMB* y 0; (4.59) 

under this condition, 

X = -A ] CMB* (BMB*)" 1 , (4.60) 

<f>(X) = D + CMC* - CMB* [BMB*)' 1 BMC* , (4.61) 

tf>(X) -4>{X) = {AXB + C)MB*(BMB*)- 1 BM(AXB + C)*. (4.62) 

(d) X = is a solution of (j4~5T|) if and only if BMB* :>= and CMB* = 0. In this case, 0(0) =D + CMC*. 

(c) X = is the unique solution (|4.51j) if and only if r{A) — p, CMB* = and BMB* >~ 0. In this case, 
0(0) = D + CMC*. 
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(e) There exists anl £ C pxm such that 

4>{X) >p 4>{X) (4.63) 

holds for all X e C pxm if and only if 

M(CMB*) C M(A) and N 0. (4.64) 

In £/iis case, ifte matrix X G C pxm satisfying (|4.63|) is unique if and only if 

r(A) =p, ffl{CMB*) C <5?(A), BMB* y 0, iV ^ 0. (4.65) 

Proof. Let 

= - <£(X) = ( + C )M( AX 5 + C*)* - ( i!5 + C) M (AXB + cY . 



Then, 0(X) ^ <£(X) is equivalent to ip(X) ^ 0. Under A ^ 0, we see from Corollary 2.2(j) that ?/>(X) ^ holds 
for all X G C pxm if and only if 

fc=0, (4.66) 



CMC* - ( AXB + Cj M [AXB + Cj CMB* 
BMC* BMB* 



which, by Lemma l3.3f e). is further equivalent to 

BMB* ^ 0, M(BMC*) C M(BMB*), (4.67) 

CMC* - [AXB + C\m(aXB + cY - CMB* {BMB*)" 1 BMC* >? 0. (4.68) 
In this case, it is easy to verify 

CMC* - [AXB + CjM^AXB + cY - CMB* {BMB*)** BMC* 

= -(AX BMB* + CMB* ) (BMB* ) t ( AX BMB* + CMB* )*, (4.69) 

and therefore, the inequality in (|4.68[) is equivalent to CMB* + AX BMB* = 0. By Lemma [3.41 this matrix 
equation is solvable if and only if 3$(CMB*) C 3%(A) and 3£(BMC*) C S$(BMB*). In this case, the general 
solution of the equation is (|4.54[) by Lemma 13.41 and (|4.68j) becomes 



CMC* - y AXB + CjMyAXB + Cj - CMB*(BMB*) t BMC* = 0. 
Thus (|L55|) and (l4~56]) follow. The results in (b)-(f) follow from (a). □ 



The following corollary can be shown similarly. 



D + CMC* CMB 
B*MC B*MB 



Then, there exists an 



Corollary 4.9 Let <fi(X) be as given in (|1.3|) . and let N 

X eC pxm such that 

4>{X) ^ (4.70) 

holds for all X e C pxm if and only if 

BMB* ^ 0, @(CMB*) C m(A), M(BMC*) C M(BMB*). (4.71) 
In this case, the following hold. 
(a) The matrix X satisfying (|4.70|) is the solution of the linear matrix equation 

AX BMB* + CMB* = 0. (4.72) 

Correspondingly, 

X = -A^CMB*(BMB*y + FaVx + V 2 E BMB ,, (4.73) 

cj)(X) = D + CMC* - CM B* (BMB*y BMC* , (4.74) 

cf>(X) -<f>(X) = (AXB + C)MB*(BMB*y BM(AXB + C)* , (4.75) 
where V\ and V2 are arbitrary matrices. 
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(b) The inertias and ranks of <p(X) and 0(A) — 0(A) are given by 

i + [cj){X)] = i+(N), i_[0(X)] = i-(N) - r(BMB*), r[0(X)] = r(N) - r(BMB*), 
i_ [ 0(X) - 0(A) } = r[ 0(A) - 0(A) } = r( AXBMB* + CMB* ). 

(c) The matrix X € C pxm satisfying (|4.70l) is unique if and only if 

r{A) = p, M(CMB*) C &(A), BMB* < 0. 

In this case, 

X = -A i CMB*(BMB*)- 1 , 

0(A) =D + CMC* - CMB*(BMB*)- l BMC* , 

0(X) -0(A) = ( AXB + C)MB*(BMB*)~ 1 BM ( AXB + C )*. 

(d) X = is a solution of (|4~70l) if and only if BMB* 4 and CMB* = 0. In this case, 0(0) = 



(c) X = is f/ie umtfue solution of <|3770"|l i/ and onZy i/r(A) = p, CMB* = and BM B* -< 0. 
0(0) = D + CMC*. 

(f) T/iere erwsis anIeC px ™ suc/i ifcai 

0(A) ^ 0(A) ^ 

ftoZtfe /or aZZ X G C pxm «/ and on/?/ i/ 

M(CMB*) C ^(A) and TV ^ 0. 
In £/iis case, i/ie matrix X s C pxm satisfying (I4.82[) is unique if and only if 

r{A) =p, £$(CMB*) C Sf\A), BMB* -< 0, N 



(4.76) 
(4.77) 

(4.78) 

(4.79) 
(4.80) 
(4.81) 

D + CMC*. 

In this case, 



(4.82) 
(4.83) 
(4.84) 



5 The convexity and concavity of in (11.31) 



As usual, the matrix-valued function 0(X) in ()1 .3[) is said to be convex if and only if 

\x x + \x^j 4 ^(X 1 ) + ^(X 2 ) 

holds for all X\, X2 € C pxm ; said to be concave if and only if 

i*! + ^a 2 ) ^(x) + ^(x 2 ) 

holds for all X x , X 2 eC pxm . It is easy to verify that 



-Xl + -X 2 
2 2 



U(Xi) - \<f>{X 2 ) = --A{X 1 - X 2 )BMB*{X 1 - X 2 )* A* , 



2 TV ' 2 TV 7 4 

which is a special case of (jl.3l) as well. Applying Theorem 14. II to (|5.3[) . we obtain the following result. 
Theorem 5.1 Let <j)(X) be as given in A 7^ and BMB* ^ 0. TTien, 



max r 



mm r 

Xi^X2,Xi,x 2 eCP xm 



max 

Xi^x 2 ,Xi,x 2 ei 



max i_ 

Xi#X 2l Xi,X 2 GCPX m 



mm i-t 

x 1 =£x 2 , x 1 ,x 2 ec>>x"> 



mm z_ 
x^x 2 , Xi,x 2 eO""» 



-Xi + ^A 2 
2 2 



2 2 



-Ax + ^A 2 
2 1 2 2 

—X-i -|- — A''> 

2 2 

-Ai + ^A 2 
2 2 

— Ai -|- — ^\ 9 

2 2 



:0(Ai 



:0(A 2 



5^2) 



0(A 2 ) 
0(A 2 ) 



= min{r(A), r(BMB*)}, 

1 BMB* y and r(A) =p 
1 BMB* -< and r(A) = p 
otherwise 

= mm{r{A), i_(BMB*) }, 
= mm{ r(A), i + (BMB*) }, 



1 BMB* <0 andr(A)=p 

BMB* or r(A) <p 

1 BMB* >- and r(A) = p 
BMB* ^ or r(A) < p 



(5.1) 



(5.2) 



(5.3) 



(5.4) 

(5.5) 

(5.6) 
(5.7) 
(5.8) 
(5.9) 
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In consequence, the following hold. 

(a) There exist X x , X 2 G C pxm with X x ^ X 2 such that cj> (jX x + \X 2 ) - \(j){X x ) - j4>(X 2 ) is nonsingular 
if and only if both r(A) = n and r(BMB*) n. 

(b) There exist X x , X 2 G C pxm with X x ^ X 2 such that <f) [\X X + ±X 2 ) = ±<f>(X x ) + \<j>{X 2 ) if and only if 
BMB* f and BMB* ^ 0, or r(A) < p. 

(c) There exist X x , X 2 G C pxm with X x ^ X 2 such that <j> (\X X + \X 2 ) >- \<t>{X{) + \<j>{X 2 ) if and only if 
both BMB* -< and r(A) = n. 

(d) There exist X x , X 2 G C pxm with X x ^ X 2 such that <j> [\X X + \X 2 ) -< \<j){X x ) + \<j>{X 2 ) if and only if 
both BMB* >- and r(A) = n. 

(c) There exist X x , X 2 G C pxm with X x ^ X 2 such that <j> (\X X + \X 2 ) ^ \<j){X x ) + \<j){X 2 ) if and only if 
either BMB* /Oor r(A) < p. 

(f) There exist X x , X 2 G C pxm with X x ^ X 2 such that <f> {\X X + \X 2 ) 4 \4>{X X ) + \4>{X 2 ) if and only if 
either BMB* -fr or r(A) < p. 

(g) 4> {\X X + \X 2 ) ^ \(f){X x ) + \<j>{X 2 ) for all X x , X 2 G C pxm with X x X 2 if and only if BMB* 4 0. 

(h) <j> (±Xi + \X 2 ) ^ \${X X ) + \<j){X 2 ) for all X x , X 2 G C pxm with X x ^ X 2 if and only if BMB* ^ 0. 

(i) If 4>(X) is a positive semi-definite matrix-valued function, then <j)(X) is convex. 
0) If 4>(X) is a negative semi-definite matrix-valued function, then 4>(X) is concave. 

6 Semi-definiteness of general Hermitian quadratic matrix-valued 
functions and solutions of the corresponding partial ordering op- 
timization problems 

As an extension of (|1.3p . we consider the general quadratic matrix- valued function 



X x ,...,X k ) = (^^AiXiBi + CjM^Y^AiXiBi + C^ + D, 



(6.1) 



where ^ A t G C nxp > , B t G C m - X? , C G C nxq , D G Cg and M € are given, and X { G C PlXm - is a variable 
matrix, i = 1, . . . , fc. We treat it as a combined non- homogeneous linear and quadratic Hermitian matrix- valued 
function <f> = t o ip; 

tp : C PlXmi © •• • ©C PfcXmfc -> C nx<? , r : C nx<? -> C£. 

This general quadratic function between matrix space includes many ordinary Hermitian quadratic matrix- 
valued functions as its special cases. Because more than one variable matrices occur in (|6.1I) . wc do not know 
at current time how to establish analytical formulas for the extremal ranks and inertias of (|6.1[) . In this section, 
we only consider the following problems: 

(i) establish necessary and sufficient conditions for <f>( X x , . . . , X k ) > ((f>( X x , ... , X k ) ) to hold for all 
X\ , . . . , Xk ; 

(ii) establish necessary and sufficient conditions for the existence of X x , . . . , Xk and X x , . . . , Xk such that 

4>{X 1 ,...,X k )^cp{X x ,...,X k ), cp{X x ,...,X k )^^{X x ,...,X k ) (6.2) 

hold for all X x , . . . , Xk in the Lowner partial ordering, respectively, and give analytical expressions of 
X x ,...,X k and X x , ...,X k . 

Theorem 6.1 Let (f>(X x , . . . , X k ) be as given in (|6.ip . and define B* = [£?*,...,£?£]. Also let 



N 

Then, the following hold. 



D + CMC* CMB* 
BMC* BMB* 



(6.3) 
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(a) (p(X 1 ,...,X k ) ^OforallX 1 G C Pl xmi , . . . , X k (=C PkXmk if and only if N > 0. 

(b) 0(Xi,...,X fc ) =<! /or allXx G C Pl xmi , . . . , X k G C PfcXmfc «/ and on/y if N 4 0. 

(c) There exist X\ , . . . , suc/i that 

4>(X l7 . . . ,X k ) fc= . . . , X fe ) 

/io/ds /or a/Z Xi G C Pl xmi , . . . , X k G C Pfe xmfe £/ and onZy if 

BMB* > 0, ,<%{BMC*) C M(BMB*). 
In this case, the matrices Xx,.. ., X k are the solutions of the linear matrix equation 

k 

^AiXiBiMB* = -CMB*. 

i=X 

Correspondingly, 

4>(X 1 ,...,X k ) = D + CMC* - CMB*(BMB*)^BMC*, 

Am 



/ k \ / k \ 

<(>(X 1 ,...,X k )- ( f>(X 1 ,...,X k )= [J2A l X l B l + C\MB*(BMByBM(J2 A * X > B * + C 



i=l 



(d) There exist X\ , . . . , Xfc such that 

4>{ Xi X k ) =4 (f>( X\, X k ) 
ZioZds /or aZZ Xi G C Pl xmi , . . . , X k G C Pfe xmfe if and onZy if 

BMB* 4 0, M{BMC*) C M{BMB*). 
In this case, the matrices X\ , . . . , are i/ie solutions of the linear matrix equation 



Y^AiXiBiMB* = -CMB* 



Correspondingly, 
cj>{Xi,...,X k ) = D + CMC* - CM B*(BM B*)^BMC 



/ k \ ( k ^ 

X u ...,X k )- <t>{X u ...,X k )=[Y, A i X i B i + C MB*(BMB*y BM £ A i X l B l + C 

Vi=i / \i=i j 



Proof. Rewrite (16.11) as 



tj>{ X u . . . , X k ) = y AiX x B x + J2 A i X i R i + C\mI AxXiBi + J2 A * X * B * + c j 
+ D, 

and applying Corollary g^] to it, we see that (j>{ Xx , . . • , X k ) ^= for all X x G C PlXmi if and only if 



£- =2 A^^ + C 
Bx 



for all X 2 GC P2Xm2 ,...,X k eC PkXmk . Note that 



D 


0" 










+ 



M 



Si=2 MXiBi + C 
Bx 



^0 



D 




J2i=2 MXiBi + C 



D 




E 

\i=2 



Bx 

A, 




M 



Si 



C 
Si 



fc r 



i M E 



vi=2 



A, 





c 
Si 
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Applying Corollary 14. 81 we see that this matrix is positive semi-definite for all X 2 £ C P2X ™ 2 if and only if 



D 





0" 













+ 














Ek 
j=3 



XiBi 
B 2 



C 
Bi 



M 



Ek 
j=3 



c 

Bi 



Bo 



> 



(6.17) 



for all X 3 £ C P3Xm3 ,...,X k £ C PfcXm <=. Thus, we obtain by induction that <j)(X x , ...,X k ) >p for all X x £ 
C PlXm \...,X k £ C PkXm - if and only if 



D + CMC* CMB* 
B X MC* B X MB{ 

B k MC* B k MB\ 



CMB* k 
B x MBt 



B k MB* k 



D + CMC* CMB* 
BMC* BMB* 



>0, 



establishing (a). 
Let 



p{X x ,...,X k ) 

= <P(x x ,. . .,x k ) - 4>{Xi, . . .,x k ) 

= A i X i B i + C J M fe AiXiBi + C\ AiXBi + °] M ( Yl A iXi B i + C 

\i=l / \t=l / V i=l / \*=1 / 

Then, 4>(Xi, . . . ,X k ) > <j>{X x , ...,X k ) for all X x £ C Pl xmi , . . . ,X k £ <C PkXm " is equivalent to 

p(X x ,...,X k )^Q for all X x £ C Pl xmi , . . . , X k £ C Pk xm " . 

From (a) , (|6.19p holds if and only if 

i r<\i\/rls^ k a.y.u. i rA i n^/rn* nnru* 

> Q, 



YX;! AiXiBi + C)M\££ sl AiXiBi + C) +CMC* CMB* 
BMC* BMB* 



which, by (|4.66j) - (|4.68|) . is further equivalent to 

BMB* ^ 0, <%{BMC*) C M(BMB*), 

CMC* - A t XiBi + c] M ( AiXBi + C ] - CMB* (BMB*)'' BMC* > 0. 



(6.18) 

(6.19) 

(6.20) 

(6.21) 
(6.22) 



In this case, 



CMC* - \ AiXBi + Cj M AiXBi + Cj - CMB* [BMB*)"* BMC* 
= - A l X i B i + C J MB*(BMB*) ] BM {^2 AiXBi + C J 



(6.23) 



i=l 



2 = 1 



holds, and therefore, (|6.22p is equivalent to CMB* + Yli= X AiXiBiMB* = 0. This is a general two-sided linear 
matrix equation involving k unknown matrices. The existence of solutions of this equation and its general 
solution can be derived from the Kronecker product of matrices. The details are omitted here. Result (d) can 
be shown similarly. □ 

Two consequences of Theorem 16. II are given below. 

Corollary 6.2 Let 

k 

il>{X 1 ,...,X k )=^2( AiXiBi + d )Mi( AiXiBi + d )* + D, (6.24) 

i=l 

where ^ Ai £ <C nxp \ Bi £ C m * X9i , C £ C" x<?i , D £ Cg and M t £ C§ are given, and Xi £ C p * xm * is a 
variable matrix, i = 1, . . . , k. Also define 

B = diag(B x ,...,B k ), C=[C x ,...,C k ], M = diag( M x , . . . , M k ), N = ° BMB* 
Then, the following hold. 
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(a) ip(X 1 ,...,X k ) fc= for all X l G C Pl xmi , . . . , X k e C PfeX " lfc i/ and only if N ^ 0. 

(b) V(Xi,...,X fc ) ^ /or aZIXi G C PlXmi , . . . ,X fc G C PfcX " ifc £/ and on/?/ i/iV ^ 0. 

(c) There exist X\ , . . . , -X^ such that 

^(X 1 ,...,X k )^^(X 1 ,...,X k ) (6.25) 
aoZds for all X 1 £ C Pl xmi , . . . , X k G 0* xm " if and only if 

BiMiB* fc= 0, M{BiMiCt) C .*•(//, .\/ ( />';;. i = 1, . . . , fe. (6.26) 
In i/jjs case, £/ie matrices X\ , . . . , satisfying ()6.25|) are £ae solutions of the k linear matrix equations 

AiXBiMiB* = -dMiBf, i = l,...,k. (6.27) 

Corresponding/?/, 

fe fc 

^(Xi, . . . , X k ) = D + Y, CiMiC* - CiMiB^BiMiB^BiMiCt, (6.28) 

i=l i=l 
fe 

^(Xi, . . . ,X k ) - . . . ,X fe ) = ^ ( AiXfBi + Ci ) MiB^BiMiB^BiMi ( iJ.B, + C )* . (6.29) 

i=i 

(d) There exist X\ , . . . , X& suc/i i/iai 

^(Xi,...,X fc ) ^ V(Xi,...,X fe ) (6.30) 
/io/ds for all X 1 eC PlXm \...,X k e C PkXmk if and only if 

B^B* 4 0, 3${BiMiC*i) C M{B l M i B*), i = 1, . . . , fe. (6.31) 
In £/zis case, £/ie matrices Xi, . . . , satisfying (|6.30[) are i/ie solutions of the k linear matrix equations 

AiXiBiMiBl = -C.M.B*, i = l,...,k. (6.32) 

Corresponding/?/, 

fe fe 

i/;{X u . . . , X fe ) = £> + ^ CiM^C* - ^ CiMiB^BiMiB^BiMiC*, (6.33) 

i=l i=l 
fe 

^(Xi, . .. ,X k ) - il>(Xi, ...,X k ) = ^{AiXiBi + C ) MiBKBiMiB^BiMiiAiXiBi + Q )* . (6.34) 



Proof. Rewrite (pT24|) as 

V>(X 1; . . . ,X k ) = + Ci, . . . , AfeXfeBfe + C fc }M[A 1 X 1 B 1 + C x , . . . ,^ fe X feJ B fe + C fe f + D 

= [AiX 1 [ J Bi ! ...,0] + --- + A fc X fc [0,...,B fc ] + [C 1 ,... ) C fc ]]M 

x [A 1 X 1 [ J B 1 ,...,0] + --- + A fc X fe [0 ! ...,S fe ] + [C l! ...,C fe ]]*+A (6.35) 

which a special case of (|6.1[) . Applying Theorem 16. II to it, we obtain the result desired. □ 

Corollary 6.3 Let 

1>(X 1 ,...,X k ) = [A^^ + d, . . . , A k X k B k + C k }M[A 1 X 1 B 1 +C U ..., A k X k B k + C k ]* 

+ D, (6.36) 

where ^ At G C" xp ', G C m « x<Zi , C G C nx «, D G Cj^ and M G C* 1+ '" +9fc are gi?;en, and X G C p > xm ' is 
variable matrix, i = 1, . . . , k. Also define 



B = diag(B u ...,B k ) and C = [C x , . . . , C k }, N = 
Then, the following hold. 
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D + CMC* CMB* 
BMC* BMB* 



(a) ip(X 1 ,...,X k ) )? for all X x £ C Pl xmi , . . . , X k e C PkXm " if and only if N ^ 0. 

(b) iP(X 1 ,...,X k ) 4 for allXi G C Pl xmi , . . . , X k e C PfcX " lfc «/ and only if N 4 0- 

(c) There exist X\ , . . . , smc/i i/iai 

^(X 1; ...,X fe ) > (6-37) 
ZioZds /or a« Z a £ C Pl xmi , . . . , X k € C PkXmk if and only if 

BMB* > 0, M{BMC*) C M{BMB*). (6.38) 
In f/ns case, i/ie matrices Xx,..., X k satisfying (|6 .37[) are ifte solutions of the linear matrix equation 

k 

AiXiBiMB* = —CMB*. (6.39) 



Corresponding/?/, 
ij)(Xi, ...,X k )=D + CMC* - CMB*(BMB*)^BMC*, 
i;{X 1 ,...,X k )-^(X 1 ,...,X k ) 

= [A 1 X 1 B 1 +C 1 ,...,A k X k B k + C k ]MB*(BMB*) f BM[A 1 X 1 B 1 +C 



(6.40) 

.,A k X k B k + C k ]* . (6.41) 



(d) There exist X\ , . . . , X k such that 

i>(X u ...,X k )4i>(Xu---,Xk) (6-42) 
holds for all X 1 eC PlXmi ,...,X k e C Pk xm " if and only if 

BMB* 4 0, M{BMC*) C M(BMB*). (6.43) 
In i/izs case, the matrices X\ , . . . , X& satisfying (|6.42l) are i/ie solutions of the linear matrix equation 



J^A^B.MB* = -CMB* 



(6.44) 



i=l 



3.45) 



Corresponding/?/, 

= D + CMC* - CMB*{BMB*y BMC* \ 
i>(X 1 ,...,X k )-^(X 1 ,...,X k ) 

= [AxXxB^ + Ci, . . . , + C k } MB*{BMB*)^BM[A l X l B l + C U ..., A k X k B k + C k }* . (6.46) 

Proof. Rewrite (|6.36l) as 

1>(X 1 ,...,X k ) = [AxXxBx + d, . . . , A k X k B k + C k }M[A 1 X 1 B 1 + C u . . . , A k X k B k + C k ]* + D 
= [A 1 X 1 [B 1 ,...,0} + ---+A k X k [0,...,B k } + [C 1 ,...,C k }}M 

x [A 1 X 1 [B 1 ,...,0} + --- + A k X k [0,...,B k ] + [C 1 ,...,C k }]*+D, (6.47) 

which a special case of (|6.1[) . Applying Theorem 16. II to it, we obtain the result desired. □ 
Many consequences can be derived from the results in this section. For instance, 

(i) the semi-definiteness and the global extremal matrices in the Lowner partial ordering of the following 
constrained QHMF 

<f)(X) = (AXB + C)M(AXB + C)* +D s.t. PXQ = R 

can be derived; 

(ii) the semi-dcfiniteness and the global extremal matrices in the Lowner partial ordering of the following 
matrix expressions that involve partially specified matrices 



A B 

C ? 



M 



A B 

C ? 



■N, 



? B 
C ? 



M 



? B 
C 1 



+ N, 



A ? 

? ? 



M 



A ? 
? ? 



N 



can be derived. In particular, necessary and sufficient conditions can be derived for the following inequal- 
ities 

r j ri r zi ri* r? ri r ? ri* [a ?i r a ?i* 



'A B~ 




A B 


4L 


' ? B 




' ? B 


4 1, 


'A ?~ 




'A ?" 


C ? 




C ? 


C 1 




C ? 


? ? 




? ? 



to always hold in the Lowner partial ordering. 
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7 Some optimization problems on the matrix equation AXB = C 

Consider the following linear matrix equation 

AXB = C, (7.1) 

where A G C mxn , B G C pxg and C G C mx <? are given, and X G C nxp is an unknown matrix. Eq. (JZHJ is one of 
the best known matrix equations in matrix theory. Many papers on this equation and its applications can be 
found in the literature. In the Penrose's seminal paper [5], the consistency conditions and the general solution 
of (|7.1|) were completely derived by using generalized inverse of matrices. If (|7.ip is not consistent, people often 
need to find its approximation solutions under various optimal criteria, in particular, the least-squares criterion 
is ubiquitously used in optimization problems which almost always admits an explicit global solution. For (|7.ip . 
the least-squares solution is defined to be a matrix X G <C nxp that minimizes the quadratic objective function 

trace [( C - AXB ){C ~ AXB )*] = trace [ ( C — AXB )*{C - AXB )]. (7.2) 

The normal equation corresponding to (|7.2I) is given by 

A* AXBB* = A*CB*, (7.3) 

which is always consistent, and the following result is well known. 

Lemma 7.1 The general least-squares solution of (|7.ip can be written as 

X = A'CB^ +F A V 1 + V 2 E B , (7.4) 

where V\, V 2 G ^nxp are ar bit rar y. 
Define the two QHMFs in (JL2|) as 

fa(X):=(C-AXB)(C-AXB)*, fa(X) := (C - AXB )*{C - AXB ). (7.5) 

Note that 

r{MX)} = r[MX)} =r(C- AXB ). (7.6) 
Hence, we first obtain the following result from Lemma 13.51 
Theorem 7.2 Let 4>\(X) and <f>2(X) be as given in (|7.5[) . Then, 



max r[(j>i(X)] = max r[6 2 (X)] = ma,x r(C - AXB )= mm irlA, C], 

xeC n *p xec ny -p xeC nK " 

mm r [fa (X)} = mm r[fa (X)] = mm r{ C - AXB )=r[A,C] 

JfGC" x P XeC ny -P X£C" x f 



" B~ 




C 


A 


C 


— r 


B 






(7.7) 
(7 - 8) 

Applying Theorem 14. II to (|7.5|) . we obtain the following result. 
Theorem 7.3 Let fa(X) and fa(X) be as given in (|7.5[> . Then, the following hold. 

(a) There exists an X G C nxp sttc/i that fa(X) >p fa(X) holds for all X £ C nxp if and only if 

&{CB*)QM{A). (7.9) 

In this case, 

X = A^CB^ + FaVx + V 2 E B , fa(X) = CC* - CB^BC*, (7.10) 
where Vi, V2 G C nxp are arbitrary. 

(b) There exists an X E C nxp such that fa(X) ^ 2 (X) /10/ds for all X E C nxp if and only if 

2%{C*A) <ZM{B*). (7.11) 

In this case, 

X = A^CB^ +F A V 1 + V 2 E B , fa(X) = C*C ~C*AA^C, (7.12) 
where Vi,V 2 E C nxp are arbitrary. 
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Theorem 17.31 also motivates us to obtain the following consequence. 



Theorem 7.4 Let A e C mxn , B e C pxq and C 6 C mx « 6e ^zuen. Then, there always exist an X e C nxp i/wrf 
satisfies 

min{ A*( (7- AXB )(C-AX".B )*A : X e C nxp } , (7.13) 
min{B(C- AXS )*(C-AXB )E* :IeC" xp }, (7.14) 

and i/ie general solution is given by 

argmin {A*(C — AXB ){C - AXB )* A : X <= C" xp } 
= argmin { _B( C — AXB )*(C - AXB )B* : X e C" Xp } 
= argmin tr \{C - AXB )(C - AXB )* } 

= A^CB^+F A V 1 + V 2 E B , (7.15) 

where V\ and V2 are arbitrary matrices, namely, the solutions of the three minimization problems in (|7.15p are 
the same. 

For (|7.1[) . the weighted least-squares solutions with respect to positive semi-define matrices M and N are 
defined to be matrices X G C" x p that satisfy 

trace [ ( C - AXB )M{ C - AXB )* ] = min, trace [ ( C - AXB )*N{ C - AXB ) ] = min, (7.16) 

respectively. In this case, the two QHMFs in (|7.16p arc 

<fii(X) = (C — AXB )M(C - AXB )* , <p 2 (X) = (C - AXB )*N(C - AXB ), (7.17) 

so that the theory on the ranks and inertias of 4>\{X) and <f>2(X) can be established routinely. 

Recall that the least-squares solution of a linear matrix equation is defined by minimizing the trace of certain 
QHMF. For example, the least-squares solution of the well-known linear matrix equation 

AXB + CYD = E, (7.18) 

where A, B, C, D are given, are two matrices X and Y such that 

trace [ (E - AXB - CYD)(E - AXB - CYD )* ] 
= trace [(E - AXB - CYD )*(E — AXB - CYD ) ] = min . 

Correspondingly, solutions to the Lowner partial ordering minimization problems of the two QHMFs 

( E - AXB - CYD ) ( E - AXB - CYD )* , ( E - AXB - CYD )*(E — AXB - CYD ) 

can be derived from Theorem 16. II 

8 Concluding remarks 

We established in this paper a group of explicit formulas for calculating the global maximal and minimal ranks 
and inertias of (jl.3|) when X runs over the whole matrix space. By taking these rank and inertia formulas 
as quantitative tools, we characterized many algebraic properties of (|1.3[) . including solvability conditions for 
some nonlinear matrix equations and inequalities generated from (jl.3p . and analytical solutions to the two 
well-known classic optimization problems on the 4>(X) in the Lowner partial ordering. The results obtained 
and the techniques adopted for solving the matrix rank and inertia optimization problems enable us to make 
new extensions of some classic results on quadratic forms, quadratic matrix equations and quadratic matrix 
inequalities, and to derive many new algebraic properties of nonlinear matrix functions that can hardly be 
handled before. As a continuation of this work, we mention some research problems on QHMFs for further 
consideration. 

(i) Characterize algebraic and topological properties of generalized Stiefel manifolds composed by the collec- 
tions of all matrices satisfying (I4.3[) - (I4.6[) . 
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(ii) 



(iii) 



(iv) 



The difference of (JOJ) at two given matrices X, X + AX G C pxm 

(j>{X + AX) - 0(A) 

is homogenous with respect to AX, so that we can add a restriction on its norm, for instance, ||AA|| = 
■\/tr[(AA)(AA)*] < 5. In this case, establish formulas for calculating the maximal and minimal ranks and 
inertias of the difference with respect to AX ^ 0, and use them to analyze the behaviors of 0(A) nearby 
X. Also note that any matrix X — (xij) pxm can be decomposed as X = X)f=i S^Li x ij e ij- A precise 
analysis on the difference is to take AX = Ae^ and to characterize the behaviors of of the difference by 
using the corresponding rank and inertia formulas. 

Denote the real and complex parts of (|1.3[) as 0(A) = 0o(A) + i0i(A), where 0o(A) and 0i(A) two 
real quadratic matrix-valued functions satisfying 0^(A) = 0o(A) and <fr[(X) = — 0i(A). In this case, 
establish establish formulas for calculating the maximal and minimal ranks and inertias of 0o(A) and 
0i (X), and use them to characterize behaviors of 0o(A) and 0i(A). 



0(x) 



Partition <j>{X) in flO|) as 

~0n(A) X2 (X)' 

0J 2 (X) 022 (X)_ 

In this case, establish formulas for calculating the maximal and minimal ranks and inertias of the submatri- 
ces 0n (X) and 022 (X) with respect to X, and utilize them to characterize behaviors of these submatrices. 



Most criteria related to vector and matrix optimizations are constructed via traces of matrices. An 
optimization theory for (|1.3|) can also be established by taking the trace of (jl.3|l as an objective function. 
In such a case, it would be of interest to characterize relations between the two optimization theories for 
(|1.3j) derived from trace and Lowner partial ordering. 



(v) 



(vi) Establish formulas for calculating the extremal ranks and inertias of 

(AXB + C)M(AXB + C)* +D s.t. r(X) < k, 

where k =<; min{p, m}. This rank-constrained matrix- valued function is equivalent to the following 
biquadratic matrix-valued function 



(AYZB + C)M(AYZB + C)* + D, YeC pxk 7 Ze 
Some previous results on positive semi-definiteness of biquadratic forms can be found in [1] [2] . 
Establish formulas for calculating the maximal and minimal ranks and inertias of 

(AXB + C )M(AXB + C)* + D s.t. PX = Q and/or XR = S. 
This task could be regarded as extensions of classic equality-constrained quadratic programming problems. 
For two given QHMFs 

cj> i (X) = (A i XB i + C i )M(A i XB i + C i )* +D i: i = 1, 2 
of the same size, establish necessary and sufficient conditions for 0i(X) = 02(A) to hold. 

Note that the QHMF in (|1.3I) is embed into the congruence transformation for a block Hcrmitian matrix 
consisting of the given matrices. This fact prompts us to construct some general nonlinear matrix-valued 
functions that can be embed in congruence transformations for block Hermitian matrices, for instance, 



ikxr 



(Vii) 



(viii) 



(ix) 



'mi 










'A n 


A 12 


A 13 


SiXi 


Irn.2 







A* 

A \2 


A22 


A 23 


B2A2-B1A1 


B2X2 


Im 3 _ 




A* 
_ A 13 


A* 
^23 


^33 



mi 






X*B* 




X* D* V* 
1 tS l A 2 t> 2 

A 2 t >2 



where 



;ai, a 2 ) 

Al,A 2 ) = [B2A2-B1A1, B 2 X 2 , I r n 3 



An 


A12 


A 


A* 

A \2 


A 22 


A 


A* 
^13 


A* 
^23 


A 



^2-°2 



im 3 



20 



which is a special case of the following nonlinear matrix-valued function 



0(JTi, X 2 ) = (A 1 X 1 B 1 + C 1 )(A 2 X 2 B 2 + C 2 )M(A 2 X 2 B 2 + C 2 )*(A 1 X 1 B 1 + C 1 )*+D. 



In these cases, it would be of interest to establish possible formulas for calculating the extremal ranks and 
inertias of these nonlinear matrix- valued functions (biquadratic matrix- valued functions), in particular, to 
find criteria of identifying semi-definiteness of these nonlinear matrix-valued functions, and to solve the 
Lowner partial ordering optimization problems. 

(x) Two special forms of ()6.1[) and (|6.24j) by setting X\ = ■ • • = Xk = X are 



In this case, find criteria for the QHMF to be semi-definite, and solve for its global extremal matrices in 
the Lowner partial ordering. 

(xi) Many expressions that involve matrices and their generalized inverses can be represented as quadratic 
matrix-valued functions, for instance, 



In these cases, it would be of interest to establish formulas for calculating the maximal and minimal 
ranks and inertias of these matrix expressions with respect to the reflexive Hcrmitian g-inverse A~ of a 
Hcrmitian matrix A, and (/-inverse B~ of B. Some recent work on the ranks and inertias of the Hcrmitian 
Schur complement D — B*A~B and their applications was given in 

Another type of subsequent work is to reasonably extend the results in the precious sections to the corre- 
sponding operator-valued functions, for which less quantitative methods are allowed to use. 
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D - B*A~B, A — BB~ A(BB~)* , A- BB- A- A(BB~)* + BB~ A{BB-)* . 



345-362. 



21 



